Approaches for Incorporating a Variety of Metadata in Transformer Operation

A plain transformer model typically leverages only one piece of metadata - position encoding - directly in the transformer model. The use of transformers typically involves expensive and complex external scaffolding before or after output generation to avoid issues such as hallucination, irrelevance, etc. This disclosure describes techniques to incorporate a variety of metadata types into the native architecture of transformer models. The additional signals can help avoid hallucinations, improve relevance, and minimize the need of expensive external scaffolding. Generalizing transformer operation to incorporate a diversity of metadata can be achieved in various ways such as adding a metadata embedding layer, conditioning self-attention on the metadata, conditioning with gated self-attention, employing a different encoder-decoder architecture, etc. Different types of metadata can help in different ways to improve the quality of the output generated by the transformer and reduce hallucinations. The techniques described in this disclosure can also support multimodal data, such as images, audio, video, or text, etc., with the metadata used representing the specific mode

Exploiting Web Matrix Permutations to Speedup PageRank Computation

Recently, the research community has devoted an increased attention to reduce the computational time needed by Web ranking algorithms. In particular, we saw many proposals to speed up the well-known PageRank algorithm used by Google. This interest is motivated by two dominant factors: (1) the Web Graph has huge dimensions and it is subject to dramatic updates in term of nodes and links - therefore PageRank assignment tends to became obsolete very soon; (2) many PageRank vectors need to be computed according to different personalization vectors chosen. In the present paper, we address this problem from a numerical point of view. First, we show how to treat dangling nodes in a way which naturally adapts to the random surfer model and preserves the sparsity of the Web Graph. This result allows to consider the PageRank computation as a sparse linear system in alternative to the commonly adopted eigenpairs interpretation. Second, we exploit the Web Matrix reducibility and compose opportunely some Web matrix permutation to speed up the PageRank computation. We tested our approaches on a Web Graphs crawled from the net. The largest one account about 24 millions nodes and more than 100 million links. Upon this Web Graph, the cost for computing the PageRank is reduced of 58% in terms of Mflops and of 89% in terms of time respect to the Power method commonly used

Immune dyscrasia in adult growth hormone deficiency: Evaluation of hemolytic complement activity (CH50) and IgG subclasses.

CH50 is a screening assay for the activation of the classical complement pathway, the immunoglobulins-mediated one, activated in several inflammatory diseases. Adult growth hormone deficiency (aGHD) is recognized as a chronic inflammatory condition, although poorly evaluated under the profile of inflammatory biomarkers. The aim of this case-control observational study is to analyze CH50 and immunoglobulins G (IgG) subclasses production in aGHD, comparing this condition to healthy controls.38 subjects were included and divided as follows: aGHD (n = 18, 6 females and 12 males); healthy controls (n = 20, 10 females and 10 males). GHD was diagnosed with dynamic test using Growth Hormone-Releasing Hormone (GHRH 50 μg i.v. + arginine 0,5 g/Kg), with a peak GH response 30 kg/m2. The two groups were evaluated for hormonal and metabolic parameters, CH50 and IgG subtypes.IgG1 and IgG2 were significantly higher in controls than in aGHD, while IgG3 and IgG4 showed a trend to higher levels in controls, although not significant. Furthermore, CH50 levels were significantly higher in aGHD.These data substantiate the hypothesis of a dyscrasia in IgG subclasses production in aGHD. As IgG levels decrease, CH50 levels do not

Global Outcome Assessment Life-long after stroke in young adults initiative-the GOAL initiative : study protocol and rationale of a multicentre retrospective individual patient data meta-analysis

Introduction Worldwide, 2 million patients aged 18-50 years suffer a stroke each year, and this number is increasing. Knowledge about global distribution of risk factors and aetiologies, and information about prognosis and optimal secondary prevention in young stroke patients are limited. This limits evidence-based treatment and hampers the provision of appropriate information regarding the causes of stroke, risk factors and prognosis of young stroke patients. Methods and analysis The Global Outcome Assessment Life-long after stroke in young adults (GOAL) initiative aims to perform a global individual patient data meta-analysis with existing data from young stroke cohorts worldwide. All patients aged 18-50 years with ischaemic stroke or intracerebral haemorrhage will be included. Outcomes will be the distribution of stroke aetiology and (vascular) risk factors, functional outcome after stroke, risk of recurrent vascular events and death and finally the use of secondary prevention. Subgroup analyses will be made based on age, gender, aetiology, ethnicity and climate of residence.Peer reviewe

Cerebral venous sinus thrombosis due to vaccine-induced immune thrombotic thrombocytopenia in middle-income countries

Background: Adenovirus-based COVID-19 vaccines are extensively used in low- and middle-income countries (LMICs). Remarkably, cases of cerebral venous sinus thrombosis due to vaccine-induced immune thrombotic thrombocytopenia (CVST-VITT) have rarely been reported from LMICs. Aims: We studied the frequency, manifestations, treatment, and outcomes of CVST-VITT in LMICs. Methods: We report data from an international registry on CVST after COVID-19 vaccination. VITT was classified according to the Pavord criteria. We compared CVST-VITT cases from LMICs to cases from high-income countries (HICs). Results: Until August 2022, 228 CVST cases were reported, of which 63 were from LMICs (all middle-income countries [MICs]: Brazil, China, India, Iran, Mexico, Pakistan, Turkey). Of these 63, 32 (51%) met the VITT criteria, compared to 103 of 165 (62%) from HICs. Only 5 of the 32 (16%) CVST-VITT cases from MICs had definite VITT, mostly because anti-platelet factor 4 antibodies were often not tested. The median age was 26 (interquartile range [IQR] 20–37) versus 47 (IQR 32–58) years, and the proportion of women was 25 of 32 (78%) versus 77 of 103 (75%) in MICs versus HICs, respectively. Patients from MICs were diagnosed later than patients from HICs (1/32 [3%] vs. 65/103 [63%] diagnosed before May 2021). Clinical manifestations, including intracranial hemorrhage, were largely similar as was intravenous immunoglobulin use. In-hospital mortality was lower in MICs (7/31 [23%, 95% confidence interval (CI) 11–40]) than in HICs (44/102 [43%, 95% CI 34–53], p = 0.039). Conclusions: The number of CVST-VITT cases reported from LMICs was small despite the widespread use of adenoviral vaccines. Clinical manifestations and treatment of CVST-VITT cases were largely similar in MICs and HICs, while mortality was lower in patients from MICs.</p

Sex differences in cerebral venous sinus thrombosis after adenoviral vaccination against COVID-19

Introduction: Cerebral venous sinus thrombosis associated with vaccine-induced immune thrombotic thrombocytopenia (CVST-VITT) is a severe disease with high mortality. There are few data on sex differences in CVST-VITT. The aim of our study was to investigate the differences in presentation, treatment, clinical course, complications, and outcome of CVST-VITT between women and men. Patients and methods: We used data from an ongoing international registry on CVST-VITT. VITT was diagnosed according to the Pavord criteria. We compared the characteristics of CVST-VITT in women and men. Results: Of 133 patients with possible, probable, or definite CVST-VITT, 102 (77%) were women. Women were slightly younger [median age 42 (IQR 28–54) vs 45 (28–56)], presented more often with coma (26% vs 10%) and had a lower platelet count at presentation [median (IQR) 50x109/L (28–79) vs 68 (30–125)] than men. The nadir platelet count was lower in women [median (IQR) 34 (19–62) vs 53 (20–92)]. More women received endovascular treatment than men (15% vs 6%). Rates of treatment with intravenous immunoglobulins were similar (63% vs 66%), as were new venous thromboembolic events (14% vs 14%) and major bleeding complications (30% vs 20%). Rates of good functional outcome (modified Rankin Scale 0-2, 42% vs 45%) and in-hospital death (39% vs 41%) did not differ. Discussion and conclusions: Three quarters of CVST-VITT patients in this study were women. Women were more severely affected at presentation, but clinical course and outcome did not differ between women and men. VITT-specific treatments were overall similar, but more women received endovascular treatment.</p